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MINIMAX  ROBUST  MATCHED  FILTERS  FOR  NOISE  UNCERTAINTY 


WITHIN  2- ALTERNATIN G  CAPACITY  CLASSES 

Evaggelos  Geraniotis 

Department  of  Electrical  Engineering 
and  Systems  Research  Center 
University  of  Maryland 
College  Park,. MD  20742 

ABSTRACT 

In  this  paper,  we  address  the  problem  of  designing  matched  filters  which  are  robust 
against  uncertainty  in  the  statistics  of  the  noise  process.  The  design  is  based  on  a 
game-theoretic  approach  in  which  a  filter  is  sought  that  has  the  maximum  worst-case 
output  signal-to-noise  ratio  possible  over  the  class  of  allowable  statistics,  that  is  the 
design  is  maximin  signal-to-noise  ratio.  The  problem  is  formulated  and  solved  for  both 
discrete-time  and  continous-time  matched  filters  with  uncertainty  in  either  the  auto¬ 
correlation  function  or  the  spectral  measure  of  the  noise.  For  uncertainty  models  deter¬ 
mined  by  2- alternating  Choquet  capacities  explicit  solutions  are  obtained  which  are 
characterized  by  the  Huber-Strassen  derivative  of  the  capacity  generating  the  class  with 
respect  to  a  Lebesgue-like  measure  on  a  suitable  interval. 
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I.  Introduction 

Robust  signal  processing  techniques  have  received  considerable  attention  in  the  last 
15  years  (see  the  tutorial  in  [l ]).  In  particular,  robust  matched  filtering  problems  have 
been  formulated  and  partially  solved  in  [2]  for  continuous-time  and  [3]  for  discrete-time 
observations. 

In  these  problems  there  is  uncertainty  in  the  statistics  of  either  the  signal,  or  of  the 
noise,  or  of  both  the  signal  and  the  noise.  Several  uncertainty  models  for  the  signal  and 
the  noise  were  considered  in  [2]  and  [3], 

In  this  paper  we  focus  on  uncertainty  in  the  noise  autocorrelation  function  (time 
domain)  or  the  noise  spectral  measure  (frequency  domain)  and  consider  uncertainty 
classes  determined  by  2-alternating  Choquet  capacities  [4]- [6]  which  were  not  examined 
in  (2]-[3].  Both  discret-time  and  continuous-time  formulations  of  the  robust  matched 
filtering  problem  with  noise  uncertainty  within  capacity  classes  are  considered. 

The  2-alternating  Choquet  capacities  classes  include  several  useful  uncertainty 
models  like  the  e-contaminated  class  [4],  the  total  variation  class  [4],  the  band  class  [5] 
and  the  p-point  class  [6],  which  have  been  very  popular  among  the  statisticians. 

The  robust  matched  filtering  problem  for  noise  uncertainty  involves  the 
identification  of  a  worst-case  noise  statistic  over  the  allowable  uncertainty  class  and  the 
derivation  of  the  filter  matched  to  this  worst-case  noise.  Then,  wrhen  this  “robust”  filter 
is  used,  for  any  other  noise  statistic  in  the  uncertainty  class  the  signal-to-noise  ratio  is 
guaranteed  to  be  better  than  for  the  worst-case  statistic. 

This  paper  is  organized  as  follows.  In  Section  II  the  notation,  the  basic  concepts 
and  some  general  results  for  uncertainty  classes  generated  by  2-alternating  capacities  are 


cited.  In  Section  III  four  problems  of  robust  matched  filtering  with  noise  uncertainty  are 
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formulated.  In  Section  IV  a  complete  characterization  of  maximin  robust  matched  filters 
for  the  aforementioned  four  problems  is  provided. 

II.  Uncertainty  Classes  Generated  by  Choquet  Capacities 

Suppose  that  Q  is  a  compact  set  and  F  is  the  cr- algebra  generated  by  its  subsets. 
We  assume  that  the  measures  m  are  only  known  to  lie  in  a  convex  class  generated  by  a 
Choquet  2-alternating  capacity  [7] 

Mu  —  {in  EM  |  m  (A  )  <  v(A),  A  EF ,  in  (O)  =  v  (fi)}  (1) 

where  M  denotes  the  class  of  all  measures  on  ( Cl,F )  and  v  is  a  2-alternating  capacity  on 

(n  ,F). 

A  Choquet  2-alternating  capacity  [7]  on  (n,F)  is  a  finite  set  function,  which  is 
increasing,  continuous  from  below,  continuous  from  above  on  closed  sets,  and  satisfies 
v  (0)  =  0  and  v  (.4  pj  B )  +  v  (A  (J  B  )<v(A)+v(B)  for  all  A  ,  B  EF .  Notice  that 
any  finite  measure  v  is  a  2-alternating  capacity;  in  this  case  the  uncertainty  class  gen¬ 
erated  by  (1)  reduces  to  Mv  —  {v  }. 

As  an  example  of  a  2-alternating  capacity  we  cite  the  e-contaminated  mixture 
model  [4]  defined  by 

Mu  =  {m  EM  |  m  (A  )  —  (l-e)m0(yl  )  +  f  in  (A  ),  A  EF ,  iu(n)  =  m0(O)},  (2) 

where  m0  is  a  known  measure  and  the  number  e  in  (0,1)  is  the  degree  of  uncertainty  in 
the  model.  Eq.  (2)  can  be  expressed  in  the  form  (1)  if  we  set 

v(A  )  =  (1  -f)m0(A  )  +  e.  (3) 

The  total  variation  model  [4],  the  band  class  (5j,  and  the  p-point  class  [5]  are  other  popu¬ 
lar  examples  of  uncertainty  classes  generated  by  2-alternating  capacities. 
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In  the  sequel  we  will  need  the  following  results  which  are  special  cases  for  the 
theory  developed  by  Huber  and  Strassen  in  [7]: 

Lemma  1:  If  t;  is  a  2-alternating  capacity  on  (n ,F),  Mv  is  a  convex  class  of  probabil¬ 
ity  measures  determined  by  it  as  in  (1),  and  X  denotes  the  Lebesgue  measure  on  O,  then 
there  exists  a  unique  Lebesgue  measurable  function  irv  :  fi— *■[(), oo]  with  the  defining  pro¬ 
perty  that  for  all  zE[0,oo]  and  Az  defined  by.  Ax  —  {nv  >  z  } 

x  \(AX  )  +  v  (Ax)  <  x\{A)  +  v{Ac),  A  GF.  (4) 

Furthermore  there  exists  a  measure  in  in  Mv  such  that  for  all  zG[0,oo] 

<  *})  =  v({*v  <*}).  (5) 

which  means  that  m  makes  ttv  stochastically  smallest  over  all  m  in  Mv  ,  and  irv  is 
equal  to  dm  / d  X,  the  generalized  Radon-Nikodym  (R-N)  derivative  of  m  with  respect  to 
X. 

The  function  irv  is  termed  the  Huber-Strassen  derivative  of  v  with  respect  to  X 
( v  may  not  be  a  measure).  The  measure  m  singled  out  by  Lemma  1  is  termed  the 
least-favorable  measure  of  the  class  Mv  .  For  the  e-contaminated  example  above  we 
have 


dm 

<1\ 


(«  )  =  max 


where  c  is  chosen  so  that  m(Cl)  =  m0(Cl). 


(6) 


We  would  like  to  mention  at  this  point  that  if  H  is  a  discrete  set,  then  rh  becomes 
a  cummulative  distribution  function  (cdf)  and  all  the  results  involving  the  capacities 
described  above  still  hold,  providedthat  we  replace  the  integrals  with  sums  and  the  R-N 
derivatives  with  probability  mass  functions  (pmf’ s).  This  duality  follows  from  an  appli- 
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cation  of  the  results  of  [7]  (especially  Lemmas  3.1  and  3.2  and  Theorem  4.1)  to  the  fol¬ 
lowing  case:  The  underlying  space  fi  is  discrete,  the  first  capacity  class  consists  of  meas¬ 
ures  m  which  are  singular  with  respect  the  Lebesque  measure,  and  the  second  class  con¬ 
sists  of  a  single  element:  the  measure  ft  which  assigns  equal  mass  to  all  elements  of  fi. 

III.  Formulation  of  Four  Matched  Filtering  Problems  with  Noise  Uncertainty 

A  general  matched-filter  design  situation  can  be  described  by  the  following  formula¬ 
tion  [2]:  Let  H  be  a  separable  Hilbert  space  (e.g.,  L2  or  Rn)  with  product  <.,.>,  and 
let  H  denote  a  space  of  bounded  (self-adjoint)  nonnegative  linear  operators  mapping  H 
to  itself.  A  matched-filtering  problem  on  H  involves  three  quantities:  a  signal  quantity 
«£//  (e.g.,  a  signal  spectrum  or  waveform);  a  noise  quantity  n  £//  (e.g.,  a  noise  spec¬ 
trum,  autocorrelation  function,  or  covariance  matrix);  and  a  filter  quantity  h  £H  (e.g.,  a 
filter  transfer  function  or  impulse  response).  The  design  criterion  for  the  filtering  prob¬ 
lem  is  based  on  a  functional  p:H  XH  xH  — ►/?  defined  by 

.,  p(h  -S  ,n  )  =  I-,  heH,  sell,  neff  (7) 

<  li ,  nil  > 

and  representing  a  signal-to-noise  ratio. 

Within  the  above  formulation,  the  matched-filtering  problem  for  fixed  s  and  n  is 
given  by 

max  p(h  ,s  ,n  ) 
heH 

and  the  matched  filter  is  h0eH,  any  solution  of  the  equation  nh0  =  s,  when  one 
exists.  Then 


max  p(h  ;s  ,n)  =  p(/«0;s  ,n  ) 

h  eH 


(8) 
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Note  that  if  n  is  invertible  we  have  h0  —  n_1s.  Four  cases  of  interest  when  there  is 
uncertainty  about  the  noise  quantity  which  is  determined  by  a  2-alternating  capacity  are 
described  next. 


Case  1.  (Continous-Time  Matched  Filtering  with  a  General  Observation  Inter¬ 
val  and  Uncertainty  in  the  Noise  Autocorrelatio  Function):  Suppose  we  observe 
a  random  process  given  by 


Yt  =  Nt+s(t),  o <(<T, 


(9) 


In  (9)  {N, ;  0 <t  <  T  }  (here  we  can  replace  [0,  F]  with  any  general  observation  interval) 

is  a  zero-mean  real  random  process  with  autocorrelation  function 

{RN  (u  ,v  )  =  n  (u  )6(u -v  );  (u  ,v  )£[0,  T  ]2},  where  n(u)  is  nonnegative  for  all  «6[0,  F], 

and  {s  (t)\  0<t  <  T  }  is  a  real-valued  square-integrable  deterministic  waveform.  For 

T 

fixed  t ,  consider  linear  filters  of  the  form  Jq  h(t  ,u  )YU  du  where  {h  ( t  ,u  );  0<u  <  T  }  is 
a  real-valued  square-integrable  function;  the  output  signal-to-noise  ration  at  time  t  is 
given  by 


SNR 


I  L  h(t  ,u)s(u  )du  |  2 

rp  rp  U  —  - - 

u  h(t  ,u)Rff(u  ,v)h(t  ,v)dudv 


(10) 


One  can  show  that  this  problem  fits  the  general  framework  developed  above  with  H 

being  Lz\0,T],  with  the  usual  L2  inner  product,  and  with 
T 

( nh)u  =  J0  Rn(u  ,v)h(u  rv)dv ;  0<u<T.  The  signal,  noise  and  filter  quantities  of 

the  general  problem  are  identified  with  the  signal  waveform  s(t),  the  integral  kernel 

Rn(u,  v)  =  n  (u  )6(u  -v ),  and  the  filter’  s  impulse  response  h{t,u),  respectively.  The 

optimum  filter  is  given  by  any  L2  solution  to  the  Fredholm  integral  equation 
T 

f  R\(u  ,v)h(t  ,v)dv  —  s(u),  0<«  <F,  which  in  this  case  reduces  to 

Jo  1 
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h  (t  ,u)  —  s  (u  )/n  ( u  ),  independent  of  t 


(11) 


Therefore,  the  signal-to-noise  ration  in  (9)  takes  the  form 

T  T 

p{h  ',s,n)—  j  /i(u)s(u)du  \2/fo  h2(u)n(u)du 


(12) 


It  is  assumed  that  the  nonnegative  function  n(u)  is  the  Radon-Nikodym  derivative  of  a 
measure  mn  ,  defined  on  the  <7-algebra  generated  by  the  interval  [0,  T),  with  respect  to  X, 
the  Lebesgue  measure  on  [0 ,T\.  The  measure  mn  satisfies  the  (fixed-noise-variance)  con¬ 
straint  mn  ([0,  T])  —  a2  and  is  known  to  belong  to  an  uncertainty  class  of  the  form  (1). 


Case  2  (Discrete-Time  Matched  Filtering  with  a  Finite  Number  of  Observa¬ 
tions  and  Uncertainty  in  the  Covariance  Matrix  of  the  Noise):  Suppose  observe 
the  random  vector 

Y{  =  Ni+Sf,  i  —  1,2,  ■  ■  ■  ,k  ,  (13) 

where  (s,- ;  t  =  1,2,  •  •  •  ,k }  is  a  real  deterministic  sequence  and  where 
{N; ;  i  =  1,2 . k  }  is  a  real  random  sequence  with  zero  mean  and  covariance  matrix  S, 

where  £,•  y  =  n,-  6,-  j  for  n,-  nonnegative  and  <!>,•  y  =  1  if  i—j  and  0  if  .  For  filters 
k 

of  the  form  hl  ,•  Y)  the  output  signal-to-noise  ratio  at  time  /  is  given  by 
i  =  i 

k  2  k  k 

SNR  =  |  ^  hi, i  s{  |  /£  £  /q,i Si  .y  hi,j  (14) 

i=i  » =  i  y = i 

Here,  of  course,  H  —  Rk ,  s  =  [«lPs2,  •  •  -  h  —[hi, i-/q, 2,  ■  ■  ■  >  hi,k  J  >  n  *s 

identified  with  XX  and  the  operation  nil  is  premultiplication  of  the  A" -vector  h  by  the 
matrix  S.  If  E>0,  then  the  matched  filter  is  given  by  S_1s  ,  which  for  =  n,  6t  j 


reduces  to 
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h[  ,  =«,-/«».  independent  of  /  (15) 

Therefore  the  signal-to-noise  ratio  in  (14)  takes  the  form 

k  k 

p(h;s,n)  =  |  E)/i,s,-  IVE^-2”.'  (16) 

»'=i  i=i 

It  is  assumed  that  the  nonnegative  function  n,-  satisfies  the  (fixed-noise-variance)  con- 
k 

straint  n,-  =  a2  and  defines  a  measure  m„  on  the  <r-algebra  generated  by 

i  =i 

{l,2,  ■••,/;}  which  belongs  to  an  uncertainty  class  of  the  form  (l). 

Case  3  (Continuous-Time  Matched  Filtering  with  Infinite  Observation  Interval 
and  Uncertainty  in  the  Spectral  Measure  of  Bandlimited  Noise):  Suppose  we 
have  the  situation  in  Case  1  with  (0,  T)  —  (-00,00)  and  with  {Nt ;  -oo<t  <00}  zero- 
mean,  second  order  stationary  with  power  spectral  measure  mN  concetrated  on  (~u0,cj0). 
Suppose  further  that  h(t,u)  —  h(t-u)  for  all  t  ,u  €(-00,00),  then  the  output  SNR  at 
any  time  is  given  by 

p(H-,S  ,mN)=—~  |  f  M*(cj)S(v)du;\2/f  |  H  (w)  |  2dmN  (o>)  (17) 

where  H  is  the  transfer  function  of  the  filter  and  S  is  the  Fourier  transform  of  the  sig¬ 
nal  waveform  which  is  laso  assumed  to  be  bandlimited  in  [~<*;0,w0].  Here  we  identify  the 
signal,  noise  and  filter  quantities  of  the  general  formulation  with  S ,  mN ,  and  H ,  respec¬ 
tively.  We  thus  have  II  being  complex  L  2(-oo,oo)  with  the  usual  inner  product  and 
hdn  (w)  —  H  (u>)dmN  (gj),  -gj0<uj<u>0.  The  optimum  filter  is  given  by 

H  (gj)  —  S(cj)/N(u>),  -gj0«jj<u>0  (18) 

imN 

- (w)  is  the  R-N  derivative  with  respect  to  X,  the  Lebesque  measure 

d  X 


where  N  (w)  = 
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on  [-o;0,a>0].  It  is  assumed  that  the  spectal  measure  mN  satisifies  the  (fixed-noise-power) 
constraint  ([-cu0,u>0])  =  Pn  and  is  known  to  belong  to  an  uncertainty  class  of  the 
form  (1). 

Case  4  (Discrete-Time  Matched  Filtering  with  Infinite  Observation  Interval 
and  Uncertainty  in  the  Spectral  Measure  of  the  Noise):  Suppose  we  have  the 
discrete-time  analog  of  Case  3.  Then  the  problem  formulation  and  the  equations  for  the 
signal- to- noise  ratio  and  the  optimal  filter  follow  from  those  of  the  continuous-time  case, 
if  we  replace  the  spectral  interval  [-<*;0,a>0]  with 


IV.  Characterization  of  Maximin  Robust  Filters 

Equation  (8)  indicates  that,  for  known  s  and  n  ,  the  matched  filter  in  the  general 
case  is  given  by  any  solution  to  nh  —  s  if  one  exists.  When,  however,  n  is  known  only 
to  be  a  member  of  a  class  N  C// ,  representing  uncertainty  in  the  noise  statistics,  the 
following  minimax  (actually  maxmin)  robust  formulation  is  motivated  [2]; 

Definition:  Suppose  that  s  £//  is  given  and  n  EN  (Zll .  We  say  that  h  EH  is  robust 
over  {s}xN  if 


inf  p(li\s,n)  —  max  {  inf  p(h\s,n)} 
n£N  IiEII  n£N 

Note  that  ( fi  ;s  ,n  )EH  X//  X//  is  a  saddle  point  solution  to  the  game  of  eq.  (19)  if 

ill f  p(fi  ;s  ,n  )  >  p(h  ,s  ,n  )  =  max  p(h  ;s  ,n  ) 
n  £N  h  Ell 

Next  we  prove  the  following  proposition  for  the  four  problems  formulated  above: 


(19) 


(20) 


Proposition:  For  each  of  the  four  problems  formulated  in  Section  III  for  which  the 
noise  statistic  belongs  to  a  capacity  class  of  the  form  (1),  the  worst-case  noise  statistic 
n  of  (20)  is  associated  with  the  least-favorable  element  in  the  capacity  class  and 
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can  be  singled  out  by  Lemma  1. 

Proof:  To  prove  this  we  need  to  show  that  (20)  is  satisfied.  Because  of  (7),  this  is 
equivalent  to 

<fi,nfi>  <  </i  ,iifi  >  (21) 

where  fi  is  the  solution  to  nfi  —  s  .  We  prove  that  (21)  is  valid  for  each  of  the  four 
cases  of  interest. 

Case  1:  We  assume  that  mn  «  X  (absolutely  continuous  with  respect  to  X)  and 
denote  the  density  by  n  and  the  optimal  filter  by  H  —  $ /fi.  The  absolute  continuity 
restriction  is  easy  to  satisfy;  for  example,  it  is  satisfied  for  the  e-con taminated  and  total 
variation  classes  if  (the  nominal)  mn°  «  X  and  for  the  band  class  if  m„°  «  X  and 
m*  «  X.  Then  we  have 

T  T 

f  fi2(t)n(t)dt  <  f  fi2dmn  =  f  s2ii~2dmn<f  s2h~2dmn  —  [  fi2(t)n(t)dt  (22) 

In  proving  the  first  inequality  in  (22)  we  used  the  fact  that  the  absolutely  continuous 
part  of  a  measure  is  no  larger  than  the  measure  itself;  to  prove  the  second  inequality  in 
(22)  we  used  the  fact  that  n  is  stochastically  smallest  under  mn  over  all  other  elements 
in  the  capacity  class. 

Case  2:  Here  we  make  use  of  the  discrete-set  version  of  Lemma  1.  The  optimal  filter  is 
/i;  —  where  «,■  is  the  pmf  corresponding  to  the  measure  mn  singled  out  by 

Lemma  1  when  applied  to  this  case.  The  equivalent  form  to  (21)  is 
'  k  k  k  k 

S  =  S  ■SV2?V2».  <  E  'S.2?V2»;  =  E  (23) 

i=l  1=1  i  —  l  »=  1 

In  proving  the  inequality  in  (23)  we  used  the  fact  that  n  becomes  stochastically  smallest 
under  m„  ,  singled  out  by  Lemma  1. 

Cases  3  and  4:  The  optimal  filter  here  is  B (u>)  =  S(oj)/N(oj)  where  (u>)  is  the  R-N 
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derivative  of  the  least-favorable  spectral  measure  m N  (singled  out  by  Lemma  1)  with 
respect  to  X.  Both  the  continuous-time  and  the  discrete-time  problems  are  represented 
here  with  common  notation.  The  equivalent  form  to  (21)  is 

/  |#  |  2dmN  =  /  1  5  |  2ft-*dmN  <  /  |  5  |  2ft~2dmN  =  J  \  ft  |  2dmN  (24) 

In  proving  the  inequality  in  (24)  we  used  the  fact  that  ftJ  becomes  stochastically  smallest 
under  m ^  singled  out  by  Lemma  1.  The  integrals  in  (24)  are  over  (-cj0,cc0]  or  over 
for  the  continuous-time  and  discrete-time  cases,  respectively. 

V.  Conclusions 

The  robust  matched  filter  for  uncertainty  in  the  noise  autocorrelation  function  or 
the  noise  spectral  measure  is  derived  for  both  continuous-time  and  discrete-time  prob¬ 
lems  when  the  uncertainty  classes  are  generated  by  2-alternating  capacities.  In  all  cases 
the  maximin  robust  matched  filter  depends  on  the  inverse  of  the  worst-case  noise  statis¬ 
tic  which  is  obtained  as  the  Huber-Strassen  derivative  of  the  capacity  generating  the 
uncertainty  class  with  repect  to  the  Lebesgue  (or  other  equivalent  measure)  on  a  suitable 


interval. 
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